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and  Greenhouse  [1958],  and  a  partial  solution  was  given  by  Gray  ill  [1954].  A 
more  general  solution  to  this  problem  is  now  presented  and  s-ireral  test  proced¬ 
ures  are  derived. 

The  variance-covariance  matrix  for  the  above  design  can  have  two  forms. 
When  the  correlation  coefficient,  p^,  differs  from  block  to  block,  an  exact  test 
of  reduced  dimension  is  proposed  which  can  be  used  in  solving  problems  in 
growth  studies.  When  pj  is  identical  to  p  for  each  block,  two  tests  are  pre¬ 
sented.  One  is  exact  when  p  is  known?  both  are  approximate  when  p  is  unknown. 

In  this  latter  case,  comparisons  are  made  between  the  two  tests  using  a  specified 
form  for  the  covariance  matrix  and  estimating  p.  For  this  example  a  Satterthwaite 
test  is  most  accurate?  but,  the  usual  F-test,  which  ignores  the  correlation, 
performs  well  when  |p|  varies  somewhat  from  zero. 
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CHAPTER  I 


INTRODUCTION 

A  basic  assumption  in  the  model  for  a  randomized  block  design  (KBD) 
having  t  treatments  and  b  blocks  is  that  the  errors  are  normally  and 
independently  distributed.  The  physical  nature  of  seme  experimental 
situations,  however,  offers  considerable  doubt  as  to  the  validity  of  this 
as s imp ti on  of  independent  errors.  Data  occur  in  cases  where  there  is  no 
possibility  of  introducing  randomization  because  the  factor  to  be  studied 
is  the  effect  of  time  or  position.  Box  [1954a,  1954^1  and  Geisser  and 
Greenhouse  [1958]  have  shown  that  these  correlated  errors  can  seriously 
affect  the  probability  of  the  Type  I  error  of  certain  tests  of  hypothesis 
from  the  standard  Analysis  of  Varianoe. 

Correlated  errors  are  particularly  prevalent  when  repeated  measure¬ 
ments  are  made  an  one  experimental  uiit  (e.g. ,  growth  curves);  in  general, 
when  randomization  of  experimental  units  to  treatment  levels  is  restricted. 

In  same  cases,  correct  tests  on  the  significance  o l  treatment  contrasts 
have  been  achieved  through  insight  as  Yates  [1937]  (theory  for  this  type 

of  solution  can  be  found  in  Qiakrabarti  [1962]  p.  62  ff) ,  or  through  the 

2 

use  of  Hotelling's  T  test  (1931)  (if  L  >  t) ,  but  no  general  approach  has 
been  given. 

The  purpose  cl  this  paper  is  to  give  seas  exact  and  approximate 
criterion#  for  testing  the  effects  oi  independent  sets  of  treatment  contrasts 
in  a  ISO  when  the  errors  are  correlated  within  a  b.cxek  but  are  independent 


1 


2 


from  block  to  block.  For  testing  the  equality  of  all  the  treatment  means , 

2 

Graybill  [1954]  has  given  an  exact  test  using  Hotelling's  T  .  But  this 
is  useful  only  when  b  >  t  and  the  covarianoe  matrix  is  the  same  within 
each  block;  it  also  involves  considerable  computation  when  t  is  large. 

The  applied  statistician,  however,  is  sometimes  confronted  with  the  case 
where  b  <  t,  or  situations  where  adequate  mans  are  not  available  for 
computing  large-order  inverses.  He  might  even  be  interested  i  a  speci¬ 
fied  set  of  treatment  comparisons.  It  is  these  areas  that  are  to  be 
studied  in  this  work. 


Cases  are  considered  wher»  the  correlations  within  a  block  are  a 


auction  of  a  single  unknown  parameter,  p^,  and  the  structure  of  the 
covariance  matrix  is  the  same  within  each  block.  The  problem  is  then 
approached  from  two  avenues  (which  in  some  cases  may  lead  to  the  same 


solution) : 

1)  Break  down  the  variance- covariance  matrix  ir.to  an  additive 
decomposition  as  illustrated  by  Good  [1969)  where  the  cor¬ 
relation  coefficient  within  a  block  is  dominant  in  only  a 
few  multipliers.  Transformations  orthogonal  to  their  cor¬ 
responding  vectors  would  lead  to  less  (usually  zero)  corre¬ 
lated  data.  Yates'  (1937)  solution  is  essentially  this; 
where  is  the  multiplier  of  only  one  additive  cospcnent 
(in  fact,  this  is  a  latent  root  and  vector  of  the  covarianoe 
matrix) . 


2) 


When  c  is  identical  to  o  for  each  block,  make  an  exact 
F-test  if  j  is  known.  Otherwise,  estimate  the  unkncsm 
correlation  parameter  and  through  this  make  an  approximate 
F-test .  A  solution  similar  to  Satterthwaite  [1946]  would 
result  when  this  is  substituted  into  Box's  theory- 


An  example  with  a  common  form  of  the  covariance  matrix  will  be  con¬ 
sidered  for  both  the  above.  In  the  latter  case,  a  Monte  Carlo  study  will 
be  made  comparing  the  exact  test  with  the  approximate  one  using  this  exasple. 
An  easily  computed  estimate  for  p  will  also  be  given- 


CHAPTER  II 


THE  C-METHOD 


Consider  a  class  of  randomized  block,  designs  with  b  blocks  and 
t  treatments  and  let  Y^  be  the  observation  in  the  j**  block  on  the  i^1 
treatment.  Assume  that  Y„  may  be  represented  by  a  linear  model 


Y.  .  »  y  +  t ,  +$.+e..  ,  i  =  1, 

ij  i  3  13 


t;  j  *  1,  •••  ,  b 


where  y  is  the  grand  mean,  x.  reflects  the  fixed  effect  of  the  i"1  treat- 

1  t 

ment  subject  to  the  condition  V  t.  =  0,  0.  reflects  the  effect  of  the 

1=1  1  3 

j*-*1  block,  and  reflects  the  error  effect.  Alternatively,  denote  che 
model  for  all  the  elements  of  the  3^  block  by 


where 


Y  =  (y  +  0^)1  +  T  +  e .  ,  j  =  1,  •••  ,  b 


’  ‘V  V  -  '  V 

V  =  (1,  1,  •••  ,  1) 


I’  “  X2,  ,  Tfc) 


E-j  =  (Elj'  V  -  '  V 


It  is  also  assumed  that 


c_.  %  N^CO,  $  ),  independently,  j  =  1,  ,  b 


where  0  is  the  null  vector  and  t.  is  the  variance- covariance  matrix  of  r 

~3  “j 


4 


5 


Suppose  it  is  desired  to  test  the  significance  of  the  treatment 
effects  in  the  model  of  (1) .  While  no  exact  test  exists  that  is  applic¬ 


able  in  all  cases  for  an  unknown  ,  it  is  possible  to  find  an  ex>.\ct 
method  for  testing  certain  sets  of  treatment  contrasts  provided  is 
of  a  special  form.  But  information  on  other  sets  may  not  be  attainable, 
and  the  test  statistics  for  these  sets  will  usually  be  correlated.  So 
the  overall  power  of  the  test  is  often  reduced.  Such  a  loss,  however, 
might  be  tolerated  at  times  in  order  to  avoid  cumbersome  approximations 
and  difficult  computations. 

Consider  a  covariance  matrix  that  can  be  expressed  as 


$  .  *  0  (1  +  p  .  M)  ,  j  =  1,  •••  ,  b 

3  ^  3 


(3) 


where  a  and  p..  are  unknown  constants  and  M  is  a  known  matrix,  t  x  t,  with 
zeros  along  its  diagonal ,  i.e.,  all  the  Y^'s  have  equal  variances.  It 
is  assumed  that  is  positive  definite.  If  has  the  form 

^  “  °2<*t  +  +  Pj  «) 


it  can  be  transformed  to 


t*  *  02(I  +  p.  M*) 

t3  j 

as  in  (3),  where  J*  =  LL'  -  -  I,  LMqL*  *=  jl,  LML*  *  M*  .  And  if 

|  ™  [l  +  M(p  .)] 

3^3 

• 

i.e.,  if  M  is  a  function  of  p^,  express  ^  as 

t,  *  c2(r  +  paM,  +  pV  +  •••)  . 

3  t  3  1  3  2 
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Then  it  might  be  possible  to  use 

•y 

-  a  Ut  +  p^Mj) 

as  an  approximation  for  ^  since  powers  of  p4  greater  than  one  may  be 
negligib  le . 

Assuming  has  the  form  in  (3)  when  using  the  RBD  of  (1),  in 
general/  greatly  restricts  the  randomization  of  treatments  to  blocks. 

In  fact  the  treatments  must  be  positioned  in  a  certain  order  in  each 
block  so  as  to  guarantee  that  the  errors  within  a  block  are  properly 
correlated/  unless  the  correlation  is  related  to  the  treatments  rather 
than  the  plots,  e  ,g . ,  see  Geisser  and  Greenhouse  [1958].  At  times, 
however,  the  treatments  in  certain  sets,  e-g.,  the  odd-numbered  treat¬ 
ments,  can  be  randomly  assigned  to  certain  plots,  e.g.,  the  odd-nunbered 
plots.  The  example  at  the  end  of  this  chapter  will  better  illustrate 
this  idea. 

With  the  $  given  in  (3) ,  it  can  be  shown  that  there  exists  a 
matrix,  C,  t  x  q,  of  rank  q  such  that 


i.e. , 


C'MC  =  $  ,  C'C  =>  I 


C't .C  =  a  I 

j  q 


(4) 


By  transforming  Y^  to  KY  ^  =  Z^  the  design  matrix  becomes  one  in  which  the 
errors  are  independently  and  normally  distributed.  This  transformation 
then  leads  to  the  necessary  statistic  for  testing  the  hypothesis: 


H  :  K  v  *  0 
o  -  - 

K  T  ft  0 


vs  H  : 

a 


(5) 
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where 


r*  -  c'lli’cc’irH'cc'  ,  c'l  j*  o 
c*  ,  Cl  -  o 


Notice  in  (6)  that  when  C'l  f  0,  C  must  bo  adjusted  for  the  effects  of 
C'l  .  The  initial  problem  then  is  one  of  choosing  the  appropriate  matrix, 
C.  Although  the  following  approach  has  many  good  properties,  there  is 
no  unique  way  of  constructing  C. 

Using  the  technique  illustrated  by  Good  [1969],  it  is  possible  to 
break  down  M  into  an  additive  decomposition,  i.s.. 


M  "  I  xi  “i ®i 

i-1  1  11 


where  Xi  is  a  latent  root  and  is  the  corresponding  orthonormal  latent 
vector  of  M.  Since  $  has  equal  variances,  M  has  zeroes  along  its  diagonal 
and  the  trace  of  M  is  zero,  i.e.,  the  sum  of  the  X^  is  zero.  Therefore, 
there  exists  at  least  one  negative  root.  Consider  pairing  each  of  these 
negative  roots,  say  X^,  with  a  positive  root,  say  X^ ,  to  form  the  separate 
ratios 


and  let  p  be  the  number  of  these  pairs  of  nogative-positiva  roots.  It  is 
suggested  that  X^  and  X£  be  choser  in  such  a  manner  that  R^  ^  is  as  close 
to  one  at  possible.  Re-label  the  ^  so  that  R^  is  the  smallest  ratio, 
R^  is  the  next  smallest  ratio,  ,  and  is  the  largest  ratio.  Now 
construct  the  orthonormal  vectors 


8 


_  1 

8 v  -  (1  +  rJ>  2(o£  +  Ry  V  '  v  “  1'  *“  '  p  (9) 

where  a.  and  a.  are  the  latent  vectors  corresponding  to  the  roots.  X»  and 
,  in  Rv  .  There  is  at  least  one  of  these  vectors  since  there  is  at 
least  one  pair  of  positive-negative  roots.  At  the  most  there  are  as  many 
such  vectors  as  one-half  the  rank  of  M  (if  the  rank  of  M  is  even) ,  i.e.. 
there  are  as  many  such  vectors  as  there  are  possible  ratios.  .  Each 
vector,  is  a  column  of  C. 

It  is  inport ant  to  realize  the  limitations  and  assets  of  the  above 
method  of  construction.  If  M  is  non-singular  and  C’l  f  0,  then  C  will 
be  useless  unless  M  has  more  than  one  pair  of  positive-negative  roots, 
for  one  such  pair  leaves  no  degrees  of  freedom  in  testing  the  hypothesis 
of  (5) .  When  M  is  singular,  there  are  no  restrictions  as  C  can  be  aug¬ 
mented  by  those  latent  vectors,  o^,  orthogonal  to  M.  Necessarily  the 
will  be  orthogonal  to  the  8y  .  Then  the  columns  of  C  consist  of  the 
constructed  vectors,  8v>  of  (9)  ,  and  tn?  latent  vectors,  orthogonal 
to  M,  i.e., 


C  *  (§]/  §2' 


0  a ,’s  orthogonal  to  M]  . 
-p  -i 


(10) 


Hence , 


r 


2 


if  r 


r+1 

2 


if  r 


rank  (M)  is  even 

rank.  (M)  is  odd 


To  show  that  tht  conditions  of  (4)  hold,  let  the  oolusna  of  C 
equal  y  ,  c  =  1,  ,  q.  Then 


9 


10 


Then  two  sets  of  contrasts  as  given  in  (5)  can  be  tested  instead  of  one, 
and  nore  degrees  of  freedon  are  involved  in  the  test.  The  colons  of 
are  the  sane  as  in  C,  replacing  1,  k,  v,  q,  and  R^  by  k^,  v^,  q^,  and 
,  R  .  The  colusns  of  C.  are  the  orthonomal  vectors 

1  Vi  2 


“v2 


—  (a, 

a  l2 


'  V2  "  l' 


*  ^ 


(12) 


where  a.  and  a,  correspond  to  the  roots,  X.  and  X.  ,  in  _R  ,  i.e., 

2  ~k2  *> 2  k2  *  v2 

R  ,  which  represents  the  ratios,  R  ,  that  equal  one;  and  q_  is  the 
*-2'*2  v  z 

number  of  these  ratios  identical  to  one.  Hence,  the  rank  of  is  q^,  i.e., 

q,  and  the  rank  of  C2  is  q2  .  If  C^l  f  0,  then  q2  must  exceed  one  or 

there  will  be  no  degrees  of  freedom  available  for  testing  the  hypothesis 

of  (5) j  and  the  restrictions  that  held  for  C  can  be  applied  to  . 

Note  that  condition  (4)  holds  using  C,  since  -  C.  For  the 

colvstn  vectors,  6  ,  are  orthonormal  so  that  C'C_  -  I  and 

-v2  22  q2 


6'  H5  , 
-v2  -v^ 


2  *2~*2 


-  X 


k2-k2 


)(a..  ~  V} 


since  the  a.  are  orthonormal  and  X  ■  -X  .  Thus,  C'HC_  *  ♦  and  con- 
-l  *.2  *2  &  l 

dition  (4)  follows.  Further,  since  *R  *  1,  <5 '  8  «  0,  so  that 

2  v2  ~v2  -vx 

C1C2  "  *  ’  Henc®'  a11  conditions  are  satisfied  and  and  C2  can  be  used 
to  test  the  hypothesis  of  the  nature  of  (5) . 

For  the  ratios,  R^,  unequal  to  one  it  is  possible  to  construct  a 
third  matrix,  C*,  with  the  properties  that 


11 


\.\  •  - 11 


Hence,  a  is  approximately  zero  when  ,R  is  near  one,  or  X.  is  near 

V3  3  V3  *3 

zero.  This  implies  that  in  tliese  cases 


C*’MC*  -  diag{av  )  r  ♦ 


so  that 


C3'*jC3  “  0  [Iq3  +  dia9UV3)J 


•  2t 

*  0  I 

q3 

So  if  the  a  are  snail,  C*'MC*  is  near  the  null  matrix,  and  it  ndefrt 

J  j 

prove  feasible  to  ignore  these  contrasts.  Then  C*  could  be  used  along 
with  C^,  or  Cj  and  C 2#  to  form  another  set  of  contrasts  orthogonal  to  the 
others.  It  is  easy  to  -erify  that  the  conditions  of  (4)  hold  with  this 
approximation. 

If  the  a  vary  greatly  so  thatC*Hc#  is  not  near  4  it  would  be 

V3  j  J 

advantageous  to  examine  this  matrix  using  the  first  method  developed  above. 


M*  -  C*'MC*  -  diag(e  )  ,  v3 


so  that 


t;  ■  •  %  *  »j  "*> 

■  CV‘)C3  • 


K  matrix,  C similar  to  C,  is  sou^t.  First,  notice  that  the  a 

4  1  v] 

latent  rocta  of  the  diagonal  matrix  M*  -  And  if  R  is  near  one. 


are 


13 


-  1  might  be  negative  or  positive  inplying  that  there  night  be  a 


negative  and  positive  a 


v3 


If  this  is  true  there  is  a  matrix,  C.,  that 

4 


can  be  constructed  with  coluans  similar  to  the  vectors  of  (9).  Now  the 
ratios,  R  ,  are  formed  using  the  a  's,  and  the  a.  are  unit  vectors ,  i.e., 

V  Vj  -1 

the  latent  vectors  of  M*  .  Letting 


C3"C3C4  ' 


it  follows  from  previous  results  that 


C3MC3  *  *  7  C3C3  *  1 


and 


C’C.  -  « 
3  1 


i  *  1,  2 


Also,  C*'MC*  is  nonsingular,  as  a  4  0  except  when  R  *  I,  and  this  is 

net  possible  by  the  manner  in  which  C*  was  constructed.  Therefore,  C*'MC* 

must  have  at  least  two  Fair  of  negative-positive  a  or  the  matrix,  C,, 

v3  3 

will  be  useless  since  there  will  be  no  degrees  of  freedom  available  for 
testing  the  hypothesis  of  (5) ,  based  on  c.  Of  course,  this  restriction 
does  not  hold  if  -  C  . 

Hynce,  it  has  been  shewn  that  by  keeping  the  R^  near  one  there  may 
exist  as  many  as  three  orthogonal  matrices,  C^,  ,  C^,  or  C^,  C^,  C*.  with 

the  properties  that 


C**: 

i 


,  i  *  1,  2,  3 


c.'s 


15  I, 


*  i  4  j 


14 
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therefore, 


C'U'C 

-  C'C  -  — ” —  ; 

l'CC'l 


KK 1  - 


I  ,  Cl  *  0 

q  -  - 

C’U'C 

I - ,  C'l  f  0 

q  l'CC'l 


(15) 


Sine*  the  Y  ^  are  i.i.d.  normal  vaxiates,  it  follows  that 

2 

Zj  -v  (Kt  t  o  KK'),  independently  ,  j  ■  1,  ,  b, 


therefore , 


I.  -  f  I  5,'  »tUt.  J02«') 


j-1 


(1 


T* 


Consider  the  q  adratic  form 


SST  -  bZ'Z 


bY’K’KY 


(18) 


*  1  w  SST 

where  Y  -  —  T  Y,  .  From  (17)  it  follows  that  — -  is  distributed  as 

-•  b  i-i  -j  02 

a  chi-square  since  KX '  is  ideaqpotent,  i.e.. 


SST  2 

—  '  V11 

c 


(19) 


whsre 


d  -  tr(XX') 


tr(I  ) 

q 


tr 


/cii'cx 

(l  >  -  trf  — -  I  , 
\  1 ' CC '  1  / 


:*i  •  o 


C'UC 


i.6 


|  q  ,  C'l  ~  0 

(q-1  ,  C'l  j  0 


Also, 


(20) 


A 


e(5')e(z  ) 

2o2  - 


i 'K'Kt 


The  KT  are  a  set  of  independent  contrasts  in  t  since  the  rows  of  K  are 
mutually  orthogonal  and  Kl  =  0  .  It  will  be  shown  aexow  that  there  exists 
a  test  statistic  for  testing  the  hypothesis 


H0:  X  =  0 
vs  H  :  a  ^  0 

a 


(21) 


Bat  this  is  equivalent  to  the  hypothesis  of  (5),  i.e., 


H  :  K;  =  0 
O  - 

vs  H  :  Kr  4  0 

cl 

or, 

H  :  k ! i  =  0  i  =  1,  ,  d 

o  -i- 

H  :  k  !  t  *  0 
a  -  l  - 


where  the  k.  are  linear  combinations  of  the  rows  of  K  and  are  mutually 

-l 

orthogonal,  or,  these  vectors  are.  the  basis  for  the  vector  space  of  K  and 
arc  orthogonal  to  1 

The  results  of  Appendix  A  will  now  be  used  in  deriving  the  test 
statistic  for  (21)  given  fcv 


17 


with 


MST 

MSE 


MST  =  ~  SST 
d 

»  |  i'Qt(A)Y 

where  Qfc(A)  is  given  in  (Al) ,  A  =  K'K,  and 

V  -  tl['  •••  »  7 


and 


MSE 


1 

(b-l)d 

1 

(b-l)d 


SSE 

y  Q  (a)  y 


where  Q(A)  is  given  in  (A2)  and  A  is  the  same  as  above.  Recall 
was  assumed  in  (1)  that 


Nbfc[E(Y),  E)  ,  Z  =  diag($J 

SSE  1 

So  — —  is  distributed  as  a  chi-square  if  —  Q  (A) L  is  idempotent, 

o*  o 

At  .A  «  K'kI  .K'K 

=  c2A  ,  from  (16) 


and  this  result  with  that  of  (A4)  inplies  that 


~Q(A)r”j  =  ~  Q  (A)  Z  . 


Hence, 


SSE 


X?CA  ) 


(22) 

(23) 


(24) 

that  it 

Now 

(25) 


(26) 


where 


1  ,  b 

-7  £  lb-1)  l  tr(K'4  ), 

0Z  D  jal  3 

from  (A5) 

(b-l)tr(K’K)  , 

as  4  •  =  o^K 

(b-l)d, 

from  (20) 

0, 

from  (A7) 

since 


Therefore , 


E  \\  -  '  K.  }  .  for  a i.  » 


qq-. 


and  from  (19) 


SST  2,„. 

—7^-  X,10)  , 

(T2  d 

if  Hq  of  (21)  is  true.  Further,  SSE  and  SST  are  independent  since  [A. 

SST  SSE 

and  (25)  imply  that  Q  (A) l’.Q  (A)  =  4-  .  Therefore,  — —  and  —  —  are  indep-.  nt 

t 

chi-squares  and  their  ratio  divided  Lv  their  respective  degrees  of  fr  edom 
yield 


MST 

p  -  -  %  p 


KSK  [d,  (b-l)d]  ' 


if  H  is  true.  And  the  hypothesis  given  in  (5)  can  be  tested  using  the 


above  result. 
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In  cases  where  there  are  two  orthogonal  matrices,  and  C 2,  ful¬ 
filling  the  conditions  of  (4) ,  the  above  argument  can  again  be  used  on 


each  .  The  only  difference  is  that  the  variables  of  C  are  now  sub¬ 
scripted.  This  results  in  two  non-centrality  parameters. 


b 

X  =  — —  t'K'K  i  ,  with  K  based  on  C 

X  z  —  X  X~  X  X 

2a 

and 


^ 2  -  ~~2  '  With  K2  based  on  C2 

2o 


which  lead  to  two  dependent  tests,  one  on  and  one  on  >, ^  •  The  hypoth¬ 


eses  are: 


Hor 

A!  =  0 

and 

H02: 

X2  -0 

vs 

Hn: 

X1  ¥  o 

vs 

H12: 

X2  ¥  0 

or. 

Hor 

kit_  =  9 

and 

H02: 

k2t  =  0 

vs 

Hir 

Ki-  *  - 

vs 

H12 1 

K2T-  ¥  - 

(27) 


C«1  =  0 
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and  SST^,  SSE, ,  and  SST^,  SSE„t  are  similar  to  SST,  SSE)  here  K  is 
replaced  by  and  K^,  respectively,  i.e.. 


MST1  - 

J-SST1 

mst2  - 

tSSIa 

MSE  x  - 

1 

Y'Q( AX)Y  ,  A1  - 

(b-1)  dx 

mse2  - 

1 

y'q(a2)y  ,  a2  -  k^k2 

(b-l)d2 

As  would  be  expected,  the  results  proved  for  C  hold  in  the  cases  of 
and  C2  since  only  a  label  has  been  changed.  But  MST^  and  MST^  are  not 
independent  since 


i.e. , 


KlKlt jK2K2  *  * 


citjc2  '  ♦ 


and  MSE ^  and  MSE„  are  not  independent  since 


Q(A  )EQ(A2)  *  $ 

i.e. , 

Cl<jC2  11  »  • 

Therefore,  and  F^  are  not  independent.  However,  these  are  marginally 
exact  tests  under  and  and  each  can  be  individually  tested. 

This  analogy  can  be  further  extended  to  cases  where  there  exist 
three  matrices,  C^,  C^,  .  The  arg\anent  is  the  same  only  there  will  be 


three  hypotheses: 
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H01s  *1  “  0  *  based  on  K1  uei  j  Cl 

H02*  X2  “  °  '  based  0,1  k2  08 f"‘9  c2 

and  A  _  -  0  ,  based  on  K*  ut,ing  c  }  • 

The  test  statistics  are  F^,  i  -  1,  2,  3,  w.iere 


Fi  *  asp  F[dt,(b-u<i1]  -  lf  H0l  u  true  •  1  ■  '■ 2- 3 


Notice  that  F^  and  are  dependent  tests  as  are  F^  and  since 

c^jci  *•.  i-  2,  3  . 

But  and  F ^  are  independent  tests  since 

Ci*1C3  ‘  C2<)C5C4 

-  *  .  ...  C'tjC*  -  •  . 

This  is  expected  since  F2  and  F^  are  functions  of  entirely  different  o^\  , 
which  are  Mutually  orthogonal,  while  F^  has  a^’s  in  cauoon  with  F^  .-'ri<s. 

F^  .  thus,  the  result  is  three  Marginally  exact  tests  of  which  two  aro 
dependent. 

Additional  testa  of  single  ingress  of  freedoM  nay  exist  provided 
the  $  are  identical,  i.«.,  •  $,  or  -  o-  The  resulting  contrast e 
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can  be  constructed  to  be  orthogonal  to  one  another  and  to  any  of  the 
above  sets.  Unfortunately,  these  tests  are  dependent  on  the  others.  The 
hypothesis  to  consider  has  the  form: 


H*  : 
Ok 


V- 


T  =  o 


k  =  1, 


,  d’ 


where  the  are  a  set  of  orthonormal  vectors  such  that 

a£l  «  °  ;  a^K'  =  0*  ,  j  «  1,  2,  3;  k  =  1,  • • •  ,  d* 


Also, 

3 

d'  -  -  1  -  >  d* 

2. 

i 

where 

(d.  ,  i:  the  matrix  C.  is  used 
1  1 

0  ,  otherwise 


(28) 


-hen  the  a^r  ait.  a  set  of  independent  contrasts  and 


ait i  ’  Hi  *  -u  ■ 


>.o 


it  is  true 


-H.!  -V 


a  •: 


:v  * 


iriht*r,  sm  c 


tioiTui  variates#. 
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and 


i£.  • 


2  n~2  2/  2' 

Now  it  is  well  known  that  if  x  <  N (u  ,  o  )  ,  then  "v  x  r 

n  a2  \2a  / 

1  ?  -  2  2 

~  )  (x.  -  x)  a.  v  (0)  ,  indeoendentlv.  So  it  follows  that 

c  ,L .  1  n-i 

0  1*1 


SST^  bfa^'Vj2 


"  ■l('k) 


where 


and 


1 ( a,'  x ) 2 
•-  ->.2  “K" 


h 


SSE* 

JL.  -  lzi _ __ 


ajt  a, 

-K  -K 


'  ‘b-i<0) 


Hence,  the  test  statistic  for  testing 


1 .  •  •  . 


H '  '  ’  =  0 

Ok  k 

vs  H'  :  /  0 

lk  k 


is  given  by 


V  &  a  c 

Hik:  Kl  "° 


>•  ST 

F*  *  'b-D - 7 

k  oMv 


if  H’  is  true 

;  jfe 


S,nce  a^Cb  a^t*.  are  not  necessarily  equal  to  the  null  matrix, 

tests  are  dependent,  as  would  be  expected. 


and 


(29) 

these 


further,  using  these  single 
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degree  of  freedom  tests  with  the  tests  based  on  the  ,  i  -  1,  2,  3, 
leads  to  sets  of  contrasts  using  a  maxima  nusfcer  of  degrees  of  freedom. 
The  combined  set  spans  the  parasmter  space  of  t  and  has  a  total  rank  of 
t  -  1,  as  this  space  is  restricted  by  the  fact  that  t '1  »  0  .  But  it  is 
desired  that  the  contrasts  obtained  using  only  C^,  C^,  and  span  this 
space  as  there  would  be  fewer  dependent  tests  and,  hence,  an  increase  in 
the  owarall  power  using  this  approach  besides  not  needing  <■  p,  for  all 

j  • 

Tn  summary,  it  has  been  shown  that,  depending  on  the  form  of  the 
matrix,  M,  there  may  exist  as  many  as  three  matrices,  C^,  C^,  Cy  but  no 
fewer  than  one,  C^,  with  the  properties  that 


C.‘MC,  •»  $  ,  C'C  »  I  ,  i  -  1,  2,  3 
li  i  i 


CJCj  -  *  ,  i  y  j,  i,j  -  1,  2,  3  . 


These  matrices  can  be  used  to  test  hypothesis  of  the  form  given  in  (5) ,  and 
the  derived  test  statibU.es  have  exact  distributions ,  i.e.,  the  F-distri- 
bution  is  used.  Vectors  have  also  been  shewn  to  exist  which  can  be  used 
in  testing  hypotheses  of  the  form  given  in  (28) ;  likewise,  these  tests  are 
exact.  Finally  the  sets  of  contrasts  formed  when  =  t  will  span  the 
apace  of  t  and  haw  a  total  rank  equal  to  t  -  1  . 

The  above  tests,  unfortunately,  were  shown  to  be  dependent  as  was 
expected,  due  to  the  form  of  $ j  .  But  each  individual  test  is  exact  and 
if  any  hypothesis  happens  to  be  of  intsrest,  it  can  be  easily  tested  at 
the  required  a-signi ficance  level  with  the  use  of  a  set  of  F  tables.  The 


actual  sets  of  contrasts  that  can  be  analysed  will  be  determined  by  the 


*bra  of  M.  Due  to  the  dependency  of  the  resulting  statistics,  a  joint  test 
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'  si.pi  ficance  using  all  the  sets  is  not  known.  Such  a  test  would  have 
an  u-level  which  would  be  quite  difficult  to  compute.  Hut  bounds  may 
exist  and  this  fact  needs  further  investigation  (this  will  not  be  done 
here).  For  the  individual  tests  mere  is  an  obvious  loss  in  power;  but, 
if  b  Is  large,  this  might  not  be  too  noticeable. 

It  is  of  interest  to  :  oint  out  that  the  dependency  above  can  partially 
be  eliminated,  but  ther  is  a  sacrifice  of  the  power  of  the  test.  To  do 
t:  is  it  is  necessary  t  m- ke  a  runs  format  ion  of  the  form  (C^  can  al-o  be 
added) 


This  might  increase  th  deg"  es  of  freedom  in  MSI,  which  is  formed  by 
pooling  MST^,  and  MST  (new  mdepo,  'nti  but  a  good  deal  of  the  information 
on  Y  would  be  ignored.  Also,  ’he  degrees  of  freedom  for  HaE,  formed  by 
pooling  MSE,  and  MSE i  (which  are  also  independent)  could  be  reduced  by  as 
met  as  q-  .  The  procedure  here  would  be  sinu1ar  tc  the  previous  one.  If 
b  were  large  this  method  could  be  used  with  much  success  but  in  general 
it  has  little  value  and  thus  will  :;ot  be  analyzed. 

As  a  final  point  recall  that  it  mioht  not  i>e  possible  to  construct 
more  than  the  one  matrix,  .  -n  this  case  there  is  only  one  test, 
other  than  the  single  degree  of  fn-ie:.  tests  wh ich  require  the  t  to  be 
identical.  Hence,  in  this  ase  the  r*-  is  no  need  to  consider  problems 


o  f  dependency 


I 
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To  understand  more  fully  the  advantages  of  the  method  just  derived, 
it  will  be  helpful  to  analyze  an  example.  Consider  a  randomized  block 
experiment  which  uses  the  model  in  (1)  and  has  a  variance- covariance 
matrix  of  the  form 


so  that 


2 

a  <It  + 


P  ,M) 
3 


3  =*  1. 


b 


(30) 


1 


y  - 


1! 


°j 


(31) 


Such  a  covariance  matrix  could  occur  in  growth  studies  where  the  treat¬ 
ments  are  applied  to  each  individual  at  specified  times.  For  :  .i  i.et.t 
time  periods  one  would  expect  a  certain  correlation  between  error  effects i 
but,  as  time  passes  and  ether  treatments  are  applied,  there  should  be 
little  or  no  correlation  between  the  former  and  these  latter  errors.  Hence, 
the  order  in  which  treatments  are  given  to  an  individual  is  not  as  restricted 
as  before .  And,  as  is  evident  from  growth  curves ,  the  treatment  effects 
decrease  with  tint'  that  a  typical  hypothesis  might  be 


I 

1 


1 


2" 


Also,  under  these  circumstances,  p  usually  varies  from  individual  to 

j 

individual  so  it  is  correct  in  using  a  different  value  for  each  person. 

Mote  that  Pj,  the  serial  correlation  between  experimental  units  in 
the  same  block,  is  restricted  by  the  condition  that 


Ip 


(32) 


which  guarantees  that  t  will  be  positive  definite,  the  eigenroots  and 

i 

eigenvectors  of  M  are  given  hv  Anderson  [1948]  as 


ir.d 


13?' 


where 


L. 

1 


Notice  that 


(34) 


!  MS 


0 

1 


when  t  is  odd 
when  t  is  even 


| 

I 

* 

I 
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29 


Therefore, 


|  ^1' 

ci- 

1  K-i' 


e  •  e 


*  e  e 


&t/2] 

~  (t-1)  /2 ,  -(trfl)/2] 


t  even 

t  odd 


Likewise,  the  columns  of  C2,  are  given  by 


1,  •••  ,  q2 


where 

,  if  t  is  even 

,  if  t  is  odd 

so  that 


(35) 


Then 


and 


C2  =  l6-l'  -2 '  *** 


qx  *  Rank  (C^) 


if  t  is  even 

if  t  is  odd 


q2  =  Rank  (C2) 


t  is  even 

t  is  odd 


(36) 


Together  and  C2  span  the  vector  space  of  H,  with  containing  the 
vector  of  the  null  space  when  M  is  singular;  thus,  there  is  no  matrix. 

Although  it  would  now  be  an  easy  task  to  derive  and  K2  and, 
hence,  the  F-statistic,  this  will  not  be  done.  Trial  and  error  has 
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revealed  that  it  is  not  necessary  to  recompute  and  using  (35)  and 
(36)  each  time  t  changes  in  value.  Since  the  C^'s  axe  not  unique,  there 
is  no  loss  in  generality  in  using  the  bases  of  the  vector  spaces  spanned 
by  the  columns  of  the  C^'a  as  the  columns  of  the  C^’s.  The  result  is  a 
patterned  matrix  for  and  which  holds  in  all  cases,  i.e.. 


1  0  0  0  0  *' 

0  0  1  0  0  *' 


0  0  0  0  1 


•  •  e  e 


0  0  0  0  0 


0  1  0  0  0  0  •••  0 

0  0  0  1  0  0  •••  0 


,  C{1  /  o 


0  0  0  0  0  1 


0  0  0  0  0  0  •  •  • 


,0-1/0 


Notice  that  the  rows  of  and  are  orthogonal  so  that 


(I  .  i  =  j 

c:c.  =  qi 


.*  ,  i  /  j 


and  the  conditions  of  (4)  hold  so  that 


C!MC.  =  $  ,  i  =  1,  2 

l  l 


therefore , 


c:| .C.  =  o2I  ,  i  =  1,  2 


ill 
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It  is  dbvious  from  (41)  that  SST^  is 


SST1  -  bY.KjKjY ^ 


i«l 


where 


b  *1 


"  bqx  ^  J,  Y2i-lfjfY2i-l,*  "  b  -jli  V2i-l,j 


and  from  (42) ,  SST2  is 


SST2  -  bY.K^Y. 


where 


q2  . 

“>  l  Ki.- 


b  *52 


Also, 


where 


'i^ii  &l2i>i 


b  ql  ,  _  _(!)—( 

3?F1  =  ^  (Y2i“l.j  "  Y2i-1,  •  "  Y- j  +  Y- 


=  —  y  y 

Y*j  qx  ii1  21-1,3 


b  °*2  _  -m  <*—(2)  \ ' 

Y  S  Y  -  Y  .  -  YUJ  +  Y  j 

i  £  1  2i,j  2i ,*  *3  ••  1 
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vh  3  re 


i.i'i 


,  q2 

r«>  .  -i-  ?  V,.  . 

•j  q2  ^  a,3 


It  now  becomes  an  easy  task  to  test  separately  the  two  hvnotheses; 


II.  ,  •  K  ■  =  0 

ul  1- 


”ir  V-  ?  - 


,=  *V_ 


HJJ:  K2l  7  5 

Usinu  { 39)  and  (40)  and  relating  this  problem,  to  growth  ctuaita,  these 

hypotheses  hoc:<"».»*: 


and 


i  *  ;  '■  ss  r  s  •  •  •  ss  1 

01  'i  3  2q  -1 


Vi  3  H  :  i  ">  t  > 

11  1  3 


H02:  1 2  ~  r4  * 


|  1  *) 


i  •  •  > 


•  *  — 


2q1~l 


1  a 


^2 


. 


If,  how-’V'V,  the  pie's ie.il  nature  of  the  problem  allows  rot  randomi¬ 
zation,  order  h;  e  treatments  i  rom  1  to  i  to  correspond  t the  ordering  of 
the  plots  in  eas'd  block  so  that  $  Las  kr.e  form  in  (30).  The  odd-numbered 

i 

treatments  b-  rarnlorj  _  .isr-i  gned  to  the  odd-numbered  plots;  likewise, 
ti.o  even-numberea  t reatm-'-ntM  aio  randomly  assigned  to  the  rven-numbered 
plots.  Then  collect,  the  iat.,  in  two  parts;  one  containing  the  observa¬ 
tions  .v, .  t-  :  •'.•M.-iic  ■  )  .  r:  >i  t  ii-atir.ehts  aiut  one  v  obtaining  •  be  observations 
or.  ui"  .■  J-r  o-br  ?od  1 1  o.rf nt  Comput  sSV  and  odd  in  t'.'o  u..ual  manner 
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for  each  set  of  data  using  SST^,  SSE^f  SST^#  and  SSE^  .  Finally  calculate 


the  test  statistics 


F1  '  (b-1>  «» 


p2  '  lb-«  isT 


To  test 


HqI  C0^“e  F1  “itb  *  F(qrl,(b-i)  (qrl|]  “  « 


i- level 


of  significance;  to  test  co spare  F„  with  a  tabled  F, 

02  ^  2  [q2~lr (b-1) (q2-l) 1 

at  an  a- level  of  significance. 

As  an  example  of  this  result  consider  the  case  where  t  «  8  .  Then 


so  that 


"l  0  0  0  0  0  0  0" 
00100  0  00 
00001000 
00000010 


01000000 

00010000 

00000100 

00000001 


t  ,  t 

qi  =  2  “  4  '  q2  "  2 


0-1  o" 


0  0 
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1*6*/ 


H  :  T  sa  T  *=  T  s*T 

02  2  4  6  8 


VS  H  :  T  >T  >  T  >T 
12  2  4  6  8 


If  ^  is  identical  for  each  block,  i.e.,  ^  where  \  has  the 

form  in  (30) ,  a  single  degree  of  freedom  test  can  be  made  on  the  remaining 
degree  of  freedom  in  the  above  example.  Notice  that 


t  -  l  -  (q1~D  -  (q2~l)  »  l  ,  as  qL  +  q2  -  t 


so  there  always  r  uns  one  degree  of  freedom  untested  using  the  $  in 
(30) .  A  general  contrast  to  use  in  this  test  is 


& 


[1,  -1,  1,  -1,  •••  ,  1,  -1]  ,  if  t  is  ever. 


-1 


Vt-i  r  -(t-n  ,  (t+D  ,1 

t(t+u  L '  t*1  '  '  ■  t-i  '  '  j ' 


t  is  odd 


and  the  hypothesis  becomes 


"or  ^-  =  0 

VS  H^:  a^T  ¥  o 


The  test  statistic  to  use  has  been  given  in  (29)  and  is  relatively  easy 
to  compute-  For  the  example  where  t  =  8,  this  hypothesis  would  become 


VS 


•  t  •  • 

01 


4 


4-  4- 

3  5 


T  4 

4 


4- 


I 

8 


i; «  -  -  *- 

“ir  i  ‘3 


4 


’  7 


:  4  t  *•  t 

4  6  8 


Ho  net? ,  if  X.  =  t,  there  exists  three  tests  which  together  test  for 

■j 

j 

t,.»  effects  of  the  t-1  independent  .  *  .itraent  contrasts.  And,  with  the 
|  oiven  m  (30 ) ,  it  is  always  possible  using  this  method  to  find  two 
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test  statistics  which  will  test  the  significance  of  t-2  of  the  t-1 
independent  contrasts.  However,  these  tests,  although  exact,  are  de¬ 
pendent  and  a  joint  test  of  significance  using  them  is  not  kncera. 

The  value  of  this  chapter  consists  in  the  derivation  of  an  exact 
test  for  testing  sets  of  treatment  contrasts  when  the  variance-covariance 
matrix  has  the  form  given  in  (3)  or  a  fora  that  cm  be  transformed  to 
that  of  (3).  Although  randomization  of  tisataents  to  plots  is  restricted, 
no  approximations  are  necessary  and  this  is  an  advantage.  The  tests,  in 
general,  are  dependent.  Thus,  no  joint  test  is  available  and,  at  tisms, 
some  degrees  of  freedom  are  analyzed  individually  causing  the  power  of 
each  test  to  be  diminished.  But  in  *(*''acicns  where  M  has  many  pairs 
of  positive -negative  roots  that  are  identical,  as  in  the  given  example, 
or  when  M  is  singular  and  of  small  rank,  the  method  of  this  chapter  is 
extremely  valuable.  Of  special  interest  is  the  analysis  given  in  the 
above  example  as  the  covariance  matrix  of  (30)  is  one  that  furnishes  a 
good  approximation  to  many  real-life  problems. 


CHAPTER  III 


THE  D- METHOD 


In  the  previous  chaptei  a  class  of  randomized  block  designs  was 
analyzed  where  the  model  was  given  by 

Y  =  (u  +  t?-51  +  '  +  t:  ,  j  =■  1,  •••  ,  b  (1) 

j  3  3 

ai.d  it  was  assumed  that 


\  N^v'Q,  t  »  independently,  j 


$ 


b 


with  the  restriction  that  {  •  could  be  written  as 


j  .  =  o"  (It  *  o .M)  (2) 

3  t  j 

where  and  r  are  'unknown  constants  while  M  is  a  known  matrix.  An  exset 

3 

method  for  resting  the  significance  of  certain  sets  of  treatment  contrasts 
was  devised  that  required  the  construction  of  a  matrix,  C,  possessing 
certain  desired  properties .  And  in  this  approach,  M  could  be  either 
singular  or  non-singular.  in  particular,  if  M  was  singular  and  also  of 
small  rank,  •'  consisted  of  the  latent  vectors  orthogonal  to  M  and  the 
vectors  formed  using  pairs  of  pos L t i ve -uegat i ve  latent  roots  of  M,  if 
there  ,tnv  .*v.u  i.ihl- .  the  present  chapter  attempts  to  give  an  alter¬ 
native  .v--.  ro  i  for  'he;;e  sir  v.ut  i ons ,  oases  where  the  rank  of  M  is 

small  i-s  . —  a:  i  ;  t  ‘  .  This  n-v  r>-t  h.  ■  :  is  limited  to  testing  one 
.e»  ryf  o'-.’r  i_v  :  \  ■  ’  .  ;  -soh;  tii**  usual  s  >  nul  •.*  dearee  of  freedom 
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tests.  And  its  test  statistics  are  much  easier  to  compute  than  those  for 
the  C  method.  It  is  noted  that  in  this  cor text,  may  be  of  the  form 

-  a2[Ifc  +  M{Pj)] 

where  the  latent  roots  of  M  are  functions  of  the  unknown  p  ^ ,  but  the 
latent  vectors  are  known  constants. 

As  before,  break  down  M  in*  o  an  additive  decomposition,  i.e., 


M 


r 


l 


X  ,  a  .  a ! 
i-1-1 


(3) 


where  ) .  is  a  non-zero  latent  root  and  is  the  corresponding  orthonormal 

vector  of  M,  with  r  being  the  rank  ot  M.  If  one  of  the  a. ,  say  a^,  i»  1, 
then  the  remaining  ck  are  a  set  of  orthonormal  vectors  orthogonal  to  1  . 

So  let 


a  ®  a . 

- 1  -l 


a" 

-r 


1, 


,  r-1 


(4) 


If  none  of  the  i  are  1,  adjust  the  z ^  so  th.-it  they  are  orthogonal  to  1, 
i.e.,  let 


where 


x. 

-l 


(I - 11')  a. 

t  t  — 


l- 


,  i  =  1  : 


How  adjust  the  x  s :  that  thev  are  orthogonal  co  one  another,  i.e.,  let 
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-i "  -i 


-2  =  h12-l  +  *2 


a*  =  h  x  +  h_  x„  +  •• ■  +  x 
-r  lr-1  2r-  -r 


(5) 


where  the  h  are  found  by  solving  equations  of  the  form 


a*'a*  “  0  ,  i  ?  j,  i,j  =  1,  •••  ,  r 


Finally,  orthononr.alize  the  a*  so  that 


vt  _■  l  •  -L  t  i  -»■  / 

~  x.  “1 


,  r 


Then  the  a*  are  a  set  of  orthonorma.1  vectors  orthogonal  to  1  .  Construct 
the  matrix 


in 


where 


IT.  = 


M*  —  V  a  tu.*' 

,L.  -l-i 
1=1 


if  no  a.  =  1 

-l 


*r-l  ,  if  one  c*_  ,  -,ay  a  ,  is  1 


so  that  M*  is  idempo<"'nt  and  M*1  =  0 
Consider  now  the  matrix 


(6) 


(7) 


D  =  I  •  —  .11'  -  M* 
t  t  — 


Then 


n  -  — 

11 :  -  '■'*)  (1 

t  t 

t 

l 

2 

(i  -  - 

11')  +  (M*) 

c  r. 

0  ,  as 

2 

CM* i  =  m*  ,  : 

I 


t  t  — 
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implying  that  D  is  idempotent.  The  rank  of  D  :.s  given 


d  =  tr  (D) 


Also, 


Note  that 


=  tr(It  -  £  11'  -  M*> 


=  t  -  1  -  tr (M*) 


t-l-r  ,  if  no  a. 

t-r  ,  if  one  a. 

‘  -i 


Dl  =  (I  -  ~  IV  ~  M*)l 
t  t -  ~ 


0  ,  cs  M*1  =  0 


Dt  .D  =  c  D(I  +  p  .M)D 
'  D  t  ^3 


2  2 

=  c  (D  +  p  .  DMD) 


~  0^  [D  +  p  .  (M  -  ~  11 1 M  “  N!*M)D] 
3  t  — — 


M*  =  a*  a* ' 


where 


so  that 


a*  -•  [a*  a*  •••  ,  a*] 
-I  -2  -m 


Lat  E,  (mtl)  *  (m+1)  ,  be  an  orthogonal  transformation  su-'.,  that 


|a*,  -p-  11 'I  B  =  (a,  a) 
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where 


u  ~  a  ^  / 


a 

-m 


] 


and  a  is  some  constant  vector  such  that 


a  '  a  =  0 


Then 


as  BB'  =  I  , 
m+1 


■  in'  +  aa' 


Therefore , 


M*  =  an'  +  aa'  -  £  11' 


and 


M*M 


if  i  'M  +  aa'M  -  ~  11  'M 


But 


M  =  a  ( di  an  \  . )  a ' 

l 


so  that 


am] 


t  diaq(A,;a' 

l 


■  s  di  an  ( A  . )  a  '  ,  as  a '  a  =  I 

i  t 

M 


aa 


di ag ( A  ) « 
as  a 1  u  =  Q  ' 
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Hence, 


M*M  =  M  -  ^  11 'M 
-  (I  “  ~  ll')M 

so  that 


(I  -  ~  11 1  )M 


M*M 


$ 


and  {11}  become 


with 


Consider 


Z. 

“I 


D}  jD  =  c2D  . 

transforming  y_.  to  DY_.  =  z  so  that 
=  DYj  =  Dt  +  De^  ,  j  -  1,  ,  b 


by  (10) 


E (2 j )  *  Dt 

and 

V(Z.)  =  Di.D 
"3  r3 

2 

■  a  D  ,  by  (12) 


S’ nee  Y..  are  i.i.d.  normal  variates,  follows  that 

2 

^  Nfc(DT,  a  D)  ,  independently  ,  j  =  1,  *••  ,  b 

and 

1  b 

I.  *  Z  l  Z  *  N  (DT,  —  o2D)  . 
b  j=i  3  t  -  b 


(12) 


(13) 


This  leads  to  the  quadratic  form 
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SSi‘  =  bZ  '  DZ 
0  —  — 


=  bY'DrnY 


-•  — • 


Y  _  i  V  y 
- 


=  bY'DY 


—  •  —  • 


as  D  =  D 


m 


=  SST  -  l  SST 
k=l 


(14) 


where  SST  is  the  usual  sum  of  squares  of  treatments  in  the  model  of  (1) , 


i.e. 


with 


and 


SST  =  b  )  (Y.  -  Y  ) 

i^l  1#  ** 


1  b  -  l  b 

Y.  =  -•  )  Y.  .  and  Y  =  —  T  y  Y.  . 

i«  b  ij  •  •  bt  .ti  ID 


j=1 


j=l  i=l 


3ST,  =  b(v'a*)2 
a  *  ~K 


SST0 

From  (13)  it  follows  that  y-  is  distributed  as  a  chi-square  since 


D  is  idempotent,  i.e., 


SST 


0  2m 


2  d 


(15) 


whore 


d  =  tr (D) 


t-l-r  ,  if  no  a .  =  1 
—  3.  — 

'  t-r  ,  if  one  a.  =  1 

-3. 


from  (9) 


and 
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It'  -  i  ,  i-’Y  (b) 


l  )  ~  )  Ct  \\*)2  ,  as  L  '  1  -  0 

2a2  (i~l  J  h  -1  ~  ~l 


Since  Li  -  0,  D.  is  a  :  ■*.  .  -i  contra 'is  j.r.  the  ' s.  And  it  will  be 

shown  below  that  there  t  statistic  for  testing  the  hypothesis 


vs  H  :  X  ?  0 


But  this  is  equivalent  tv:  the  hypothesis 


which  can  be  written  as 


'1  :  P;  .) 

(I 


H  •  H:  ■,  0 

L 


H  :  i '  -  0 

■J  -  i  - 


11,:  >4 1 


where  ;  *..»•  d.  a*  •  ■  1 1  >•  .nr  on;  .  i  i  ,  t  Lens  ct  the  io>  s  of  b  «u»a  a»  c  f«utuaiiv 
- 1 

orthO’-K’'i«»  1  >  or  they  ate  lav-  asm  of  the  v  ctor  spat*  of  b  ami  are 


neces.s  u  i  ly  rthoijeiiai  re  1  . 


Us  inn  t  h«:  result  ot  '.'i-ondii,  X  ,  *  nt.  test  statistic  tar  11,  is 
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where 


with 


and 


and 


SSTq  =  Y'Qt(A)y  ,  using  (Al) 


A  *  B  =>  D 


Y*  =  (Y[,  Y^ «  •••  ,  Y^} 


SSEq  =  Y'Q(A)Y  ,  using  (A2) 


(18) 


i.e. 


m 


SSE  =  SSE  -  y  SSE 

0  L  u 


k=l 


(19) 


where  SSE  is  the  usual  sun  of  squares  of  error  in  the  model  of  (1),  i.e.. 


b  t 


and 


sse  =  y  y  (y. .  -  y  .  -  y.  +  y  : 

j=l  i=l  13  ^  1#  " 


kJ  , 

SSEk  =  l  [(Y  -  Y.) '  a*]' 

i-1  J 


Recall  that  it  was  assumed  in  (1)  that 


Y  “V  Nbfc[E(Y)  ,  E]  ,  l  ®  diag(^) 


SSE  1 

so  — —  is  distributed  as  a  chi-square  if  —  Q( A)  E  is  idempotent. 

a2 

this  follows  from  (A4)  and  (12)  and 

SSE 

— xia) 

2  e  e 


But 


where 
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and 


since 


-  (t»— 15 b  tr(A^Lj)  ,  from  (A6) 

o  ' 

=  (b-l)tr(D)  ,  from  (12) 

=  (b-l)d  ,  from  (9) 

X  =  0  ,  from  (A7) 
e 

E (Y ^ ) D  =  t’D  =  constant  ,  for  all  j 


Therefore, 


SSE0  2 
— —  v  (0) 

2  A  (b-1)  d'u; 


(20) 


and  from  (15) 


SST 


“  'V  •  if  Hq  of  (.16)  is  true 


Further,  SSTg  and  SSEQ  are  independent  since 


(A) IQ (A)  =  $  ,  using  (A3)  and  (12) 


Therefore,  the  ratio  of  SSTQ  to  SSEg  divided  by  their  respective  degrees 
of  freedom  yields 


0 


(b-1) 


SST0 

SS£q  %  F[d, (b-1) d] 


if  Hg  is  true 


(21) 


And  Hg  can  be  testad  by  evaluating 


.3 


m 


SST„  =  SST  -  y  SST, 
0  k=i  k 


and 


m 


SSE„  =  SSE  -  y  SSE 
0  k=l  * 


Since  d  should  be  close  to  t-1  there  will  remain  only  a  few  contrasts 
in  the  r's  that  are  not  included  in  (16).  If  t4  is  identical  from  block 

j 

to  block,  i.e. ,  i  .  =  Y  ,  or  p.  -  o  ,  for  all  i  ,  it  will  be  .  ^sible  to 

3 

test  for  the  significance  of  these  contrasts.  Consider  hypotheses  of  the 
form 


Ok' 


=  0 


k  =  1, 


and  recall  that  the  a*  are  orthonormal  vectors  with 

-k 

j^'l  =  C  ,  k  =  1,  •••  ,  m 

'.i* '  D  a,*'  (I  -  ~  11'  -  M*) 

-k  -k  t  — 

=  0  '  ,  as  a  '  M  =  a*  ' 

-k  -k 

Then 


so  that 


whe  re 


>*'Y  .  N .  I  .D.  (a*'T  , 
-k  -3  -k  - 


N  (  t* ' t  , 
-k  - 


1 

b 


V 


-k 


(22) 


(23) 
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•2 

2  n  2 1 

It  is  well  known  that  if  x  ^  N  (p  ,  a  ),  then  — —  'v  x-.l-^trl  and 


1  *  ■*  2  2 

—  £  (x^  -  x)  xn  i  •  independently-  Thus, 


o  i=*l 


where 


SS,k  !„  , 

T~  *i(V 


SST  =  b(Y!a,*}  ,  from  (14) 

k  -*  -k 


X‘Qt -  '  ^^9 


(Al) 


with 


and 


Also, 


\ 


=  a-k  «-k’ 


Ak  -  2  2|P 

2  o 


SSE  =  V  [  (Y  .  -  Y  )  *a*l  ,  from  (19) 
j=l  “  "* 


=  Y'Q(A^) Y 


Then  the  test  statistic  for  testing  (22)  becomes 


SSTk 

F  =  (b-1)  — T -  ^  F  ,  if  H  is  true 

k  (1,d-15  Ok 


(24) 


Hence,  tests  of  single  orthogonal  contrasts  are  possible.  And  each  of 

these  tests  are  independent  of  the  statistic  given  in  (21) . 

Note  that  SST  and  SHE,  are  independent  as 
0  k 


( -■')  ■■  >.  !>  ••V. '  s  •  , 


for  all  k 
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' ne  simple  method  of  testinq  would  be  to  test  of  (16)  at  a  signifi¬ 
cance  level  of 


‘o  =  pr 


F  '  F  i  H 

o  [d,(b-i)d]  !  o 


which  is  the  probability  of  rejecting  when  is  true,  and  test  K  ^ 
of  (22)  at  a  significance  level  of 


‘1  ~  ‘"rlKl  -  F(l,b-1]  !  H01 


Then  reject  ii1  if  cither  or  H  „ ,  is  rejected,  and  do  not  reject  H*  if 

0  01  o 

both  ii  and  H_,  arc-  not  rejected.  Since  P.  and  F,  are  independent 
0  0 1  J  0  1  ^ 


?"“0  -  f  [d,  (h-l)dl  '  '  1 


[ 1/b-l] } 


I  _ 


4 


0  -  ■  fd, (b-1) d] 


p  r  •  f  <  r 

1  -  [l.b-1 


and  it  lollow.;  '.hat 


-  (i  -  u0; (i  -  3l) 


•i  -  i  r  reject 


-l  -  ( i--t  )  (  l_a  ! 

0  I 

and  ..i  will  be-  tne  significance  level  of  this  test.  Note  however,  that 
for  fiv-'d  ■->  there  exist  an  infinite  number  jf  choi ces  for  a  and  a  . 

0  J. 

To  e  limn  ate  this  di  sad  vantage  consider  combining  F  and  F,  into 
i  -3  in  ;Io  test  so  that  the  cower  of  the  combined  too-  is  greater  than 
either  of  the  individual  tests.  The  method  was  devv.  loped  bv  Toler  and 
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which  is  the  probability  of  the  F-ratio  exceeuing  the  calculated  if 
Hq  is  true.  Then  the  critical  region  for  this  hypothesis  is  given  by 

“  (Vl  i  C.}  (27) 

where  is  a  constant  depending  on  an  a-level  of  significance  and  0  is 
a  weighting  factor  (0  <  0  <  1)  which  weights  F^  relative  to  F^  .  When 
0=1,  both  tests  are  given  equal  weight  and  this  is  equivalent  to  the 
method  of  iisher  [1954]  For  combining  independent  tests  of  significance. 
In  this  case  the  probability  of  a  Type  I  error  for  the  combined  test  is 


a  =  Pr {reject  Hq|h^| 


-  Hvi  -  c>;! 


i  I  dF0  dP  ,  given  in  (27) 


since  P.  is  distributed  uniform  when.  H’  is  true.  Bv  fixing  a  it  is 
D  0 

possible  to  solve  fc-i  C  to  find  the  critical  value  of  this  test. 

Since  FQ  h  <s  more  degrees  of  freedom  than  it  should  be  weighted 
more  than  F^,  i.e.,  there  should  be  a  better  choice  for  0  than  6=1. 

In  Hq  there  are  d  independent  contrasts  being  considered  each  having  the 
formd.'t  -  t*  ,  where  d!l  =  0,  i  =  1,  •••  ,  d;  and  in  H_.  there  is  one 

-i-  i  -i-  01 

contrast,  say  a*'t  =  ^  .  In  totality  there  are  t-1  possible  contrasts 

so  the  giver,  x's  span  a  certain  portion  of  the  parameter  space  of  t  .  It 
seems  appropriate  then  to  weight  the  statistics  for  HQ  and  in  proportion 
to  their  influence  on  this  space.  A  good  choice  for  0  would  be 


so  that 
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and 


a) : 


i  .  I 


PA  V  <  c 
0  1  -  a 


“  ■  I  j  *0  ®1  • 


On  the  average  this  result  will  lead  to  more  power  in  the  combined  test 
if  0  has  been  chosen  correctly  and  it  eliminates  having  to  choose  a0  and 

al  * 

In  summary,  when  the  rank  of  M  is  snail  a  method  for  testing  the 
significance  of  the  d  contrast:'  in  the  r's  as  given  in  (16)  was  developed. 
The  derived  test  is  unique  and  is  based  on  an  F-statistic,  i.e.,  the 
F-distribution  is  used.  For  all  other  contrasts  single  degree  of  freedom 
tests  exist  provided  $ ^  =  $  .  And  these  individual  tests,  althoucpi 
usually  correlated  among  themselves,  are  all  independent  of  the  test 
for  (16).  Bach  test  is  exact  and  easily  performed,  but  a  joint  statistic 
would  be  difficult  to  find.  In  situations  where  ^  =  j: ,  for  all  j,  one 
of  the  single  degree  of  freedom  tests  can  be  combined  with  the  formulated 
tests,  and  a  combined  test  results.  It  is  then  an  easy  task  to  analyze 
the  combined  hypothesis  at  any  fixed  a-level  of  significance.  This  set 
and  the  other  sets  of  contrasts  formed,  span  the  space  of  x  and  have  a 
total  rank  of  t-1  . 

To  better  understand  the  advantages  of  this  method,  it  will  be 
helpful  to  sketch  an  example.  Consider  a  randomized  block  experiment 
using  the  model  in  (1)  with  a  variance-covariance  matrix,  similar  to 
the  dispersion  matrix  proposed  by  Williams  [1970]  for  the  offspring  in 
an  animal  breeding  experiment.  There  is  a  slight  modification  in  that 


*  - 1,2  [t +  i  \  a-i  “i) 

1=1  I 
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using  F  =*  (b-1) 


SSI . 

SsiT 


as  a  test  statistic. 


Fr,  where 

[d, (b-1) d] 


Compare  F^  to  a  tabled 


d 


if  no  =  1 
of  one  a.  =  1 


Single  degree  of  freedom  tests  having  the  form  of  (22)  can  also  be 
made  since  ^  =  $  .  Further,  instead  of  using  the  test  above  for  H^, 
one  can  make  a  combined  test  on  the  hypothesis 


D  T  -  0 


which  considers  d+1  independent  contrasts.  The  method  to  use  has  been 
outlined  above. 

In  thir  charter  a  new  criterion  has  been  derived  for  testing  sets  of 
treatment  contrasts  for  the  model  in  (1)  with  the  covariance  matrix  of 
(2)  where  the  matrix  M  is  assumed  to  be  singular  and  of  small  ran1-  . 

Since  this  method  requires  only  the  calculation  of  the  latent  vectors 
of  the  non-zero  roots  of  M,  it  has  much  value  in  the  above  situations. 

It  is  extremely  easy  to  compute  the  test  statistics,  as  is  evident  from 
the  forr.ulaes  in  (14)  and  (19),  and  single  degree  of  freedom  tests  require 
little  additional  work.  The  method  of  Chapter  I,  however,  can  also  be 
used.  But  this  approach  requires  the  derivation  of  all  the  latent  vectors 
and  roots  of  M,  and  necessitates  much  more  time  and  effort  in  obtaining 
its  test  statistics.  So  the  present  D-method,  due  to  its  ease  and 
simplicity,  would  usually  be  preferred  over  the  C-method  when  M  has  the 


above  properties. 


CHAPTER  XV 


njO  TESTS  FOR  EQUALITY  OF 
TREATMENT  MEANS 


In  Chapter  II  a 


randomized  block  experiment  was  introduced  using 


the  model 


(u  +  SJi  +  l  +  £ .  »  j  =  1' 


Y.  *  (u  +  +  I  T  E4 

-J  ^  3 


where 


e  <  <v  N  (0,  t  .)  »  independently ,  1*1'”’  '  b  ^ 

-j  t  -  3 

and  $ .  could  be  transformed  to  the  special  form 

t,  -  «,<it  *  Pj M)  •  131 

Cons  i  an  r  now  the  cane  where  0j  -  p,  for  ell  j,  so  that  ^  -  L  for  ell  3- 
Of  interest  is  the  hypothesis 

K  :  T.  -  0  ,  i  »  lr  *•*  »  t 

0  l 

(4) 

vs  H  :  at  least  one  ^  0 
which  is  equivalent  to  the  hypothesis 


Hn:  H't  »  0 
o  ~ 

vs  Hxs  H’t  f  0 


where  H  is  a  t  *  (t-1)  matrix  satisfying 
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hh'  -  r  -  -  T" 


[  -  —  11'  «  Q 

t  t  ~~  Wt 


H'H  -  I 


t-1 


and 


H'l  =  0 


(5) 

(6) 


This  chapter  derives  an  exact  as  well  as  an  approximate  test  statistic 
for  testing  this  hypothesis.  If  p  is  known  the  exact  test  should  be  made; 
and  if  p  is  unknown,  either  test  can  be  made  provided  there  exists  an 
estimate  for  p .  In  either  case  one  can  analyze  the  effects  of  all  the 
treatment  contrasts. 

Consider  now  the  derivation  of  the  exact  test  statistic.  Since 
the  Yj  are  i.i.d.  normal  variates  it  follows  that 

H'Yt  -v.  g  H'$m  .  (7) 

Let 


SST*  -  o^bY'HtH'^H)”^!'^  (8) 

SST*  i  .  -1 

Then  — —  is  a  At -square  variate  if  (H'fHHH'fH)  is  idsnpotent*  This 

A 

a 

holds  since 

[(H'$H) _1]2  -  Ifc_1  -  (H'^H)'1 


Therefore , 


with 


SST* 

2 

o 


(X*) 


t*  -  tr[(H*$H) 


(9) 


ES 


t-1 


(10) 


and 


\*  a  ~  T 'H ~^K'T 
<■  "  * 

Notice  that  (H'$H)  *  can  be  written  a3 


- 1  "r  * 

(H'f.H)  L  =  l  a,.  Xi  y! 


/here  uj.  is  a  Lr.t-nt  root  (positive'  and  y.  is  the  cor  res;  cf.dinn  lr.r.*»n 

i  4i 

vector  of  (H't'M  '  .  Hence, 


(v.'H’-r 


•  >  the  'r-’f-iv:  iv 


s  a*  *  o 


is  equivalent  to  the  hypothesis 


H0:  i'H’2  ^  0  -  i  «  1,  •••  ,  t-1 


vs  H, :  at  least,  one  v  !  H '  t  ¥  0 

1  "i  - 


But  tne  • 'H'  are  linear  coriri  natrons  of  the  rows  of  h '  and  are  mutuallv 

-l 


•>  rt  h  ooon  a  1  si  nee 


'H’HV  = 


.  as  !!  H  =  I  , 
1 


are  orthogonal 
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So  this  hypothesis  is  equivalent  to  the  one  in  (4) ,  i.e., 


Hq!  H’t  =  0  ,  or,  ■  0,  for  all  i 

vs  H^:  H't  ?  0  ,  or,  at  least  one  »  0 


It  will  be  shewn  below  that  there  exists  a  test  statistic  for  testing 


this  hypothesis. 


Using  Appendix  A,  let 


so  thc.c 


and  let 


A  «  H  (H ’t H)  _1H *a2 


SST*  =  Y'Qt(A)Y  ,  using  (Al) 


SSE*  =  Y*Q(A) Y  ,  using  (A2) 


Recall  that  it  was  assumed  that 


Y  %  Nbt(E(Y) ,  i)  ,  z  ■»  diag(^) 


SSE*  1 

Then  — —  is  distributed  as  a  d.i-square  if  — r  Q(A)Z  is  idenpotent.  New, 

a2  a2 


A$A  -  a2H(H,$H)-V$H(H'$H)'1ri'c' 


2 

■  0  A 


and  this  result  with  that  of  (A4)  implies  that 


Hence, 


SSE*  2,,  x 

a2  *  8 


60 


where 


(02 


e  =  trj—  Q(A/ 
1  * 


and 


=■  —z  (b-l)tr(A|;)  ,  from  (Aj6) 


*  4  (b-l)trt  (H'^H)  1{H'|h)o2]  ,  by  cy:  ic  permutation 


-  (b-1)  (t-1) 


X  ■  0  ,  from  (A7) 
e 


since 


S(Y!)A  »  t'h(H,|h)"1H'  ,  for  all  j 


There  fore , 


SS£< 


'  x(b-lHt-l)101 


(13) 


SST*  2 

and  from  (9)  — ~  \  >  if  HQ  of  (4'  is  true.  Further,  SST*  and 

SSE *  are  independent  since  (A3)  and  (12)  imply  that  Qt(A)EQ(A)  *  *  . 
Therefore,  SSE*  and  SST*  are  independent  chi-squares  and  their  rr.'  io 
divided  by  thei  r  respective  degrees  tree  do:"  1*  Id 


:st* 


F*  -  (b-1)  F[(t_1)/(b_1)(t_in  -  if  H0  of  (4)  is  true  .  U4> 


In  order  to  evaluate  (H  ’tH)"1  consider  the  orthogonal  mat.ix,-  H*, 


,  wnere 
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M  -  [a^,  **•  *  diag(X^) 


(17) 


so  that 

M2  -  [g^  •••  -atl  diagj  .^j 

Therefore, 


(a^»  •••  *  stl  diagj  A  ^  J 


-  diag(Xi)  /  as  <l'i  Sj  *  °'  1  *  ^ 


1  1 
M-2  M2 


diag|»/Xi  ) 


^t 


and 


I  +  dM 


1 

,2 


-1 

(I  +  p  diagCXJ  1 
diagd  +  pX  J 


Ther 


M 


1 

2 


+ 


V 


diagf 


X,  (i 


t 


I 


V*  a,  a* 
i  -i  -i. 


so  that 


2-1  t 

o  H(H'$HJ  V  -  ^  -  p  l  “  P 


(i  ^rgtet8i.)([  >g,g1ii<»t) 


t  -  p  [ 

1  i  X 


Therefore, 


SST*  «  o^bY'H(H'tH) ”^H'Y 

••  T 


rt  y 

t  [I »{ 1'  «i  i:  ot  SlJ 

I:«ti  -  o  I  -  »2 - * - 


t  -  p  I  **<r  a.)4 
1  1 


“SST  -  pSST1  -  P*SST 


where  SST  is  the  usual  sunt  of  squares  treatment  in  a  randomised  block 
experiment,  i.e.f 


SST  -  b  l  (Y,  -  Y  )‘ 

l-l  " 


SST1  «  b  l  X*(Y'Q O  V 
i*l 


SST2  “  b 


t  -  P  l  X*(l*«  ): 
1 


Further,  recall 


S3i2*  =  Y  ’  Q  ih)  V 


V  Y'.AY  .  -  PV ‘AY 
4=1  - 1  -i  -  - 


V  (Y.  -  Y  )  \\(Y  -  Y  ) 

i-  -"1  *  -* 

3=i  J 


»  t  .  ,  b 

F  F  >sti!,-S‘i,!1iV  I 

i  ,--1  J  *■  *■  j«i 


r  t  _  f 

,  V  A*l'a, (Y.-Y  ) 'Q  a. 

b  [>!  1-  -1  -3  -  V»J 


t  -  p  )  ).*(!’ a.)' 


;y  -  r 


t '  •  -  , 


where  3SE  is  the  •  e-nil  &\m\  cf  squares  of  error  in  a  RBD,  i.e. , 


b 

t 

L 

i 

■M 

“ij  ' 

K 

y 

t 

V 

j  .  i 

r 

l  Afl'3. (Y.  -  Y  ) ’O  u.  I 

Ui  -1  ~3  ■; _ yl  \ 


t  -  p  y  A  *  ( 1  •  a . )  ‘ 
i»l  1  "  _1 


Using  (21}  ano.  (2 1)  with  (14)  it  would  now  o?  possible  to  test  she 
hypothesis  of  (4)  provided  p  is  (mown  or  can  be  estimated.  However,  the 
applied  statistician  may  desire  on  easier  _pprcaah  so  this  problem  that, 
a  1th  ug  not  exact,  can  still  be  used  with  a  high  degree  of  success.  It 
is  natural  then  to  turn  to  an  approximate  F-statistic.  Jn  this  method 
S.?P  iron  (2.2)  and  P.iE  from  (74)  are  use!  to  form  the  original  F-rati  >  ur.d 
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focmulaes  ana  then  necessary  to  obtain  the  adjusted  degrees  of  freedom. 

The  following  method  is  generally  referred  to  as  a  "Satterthv'aite 
method"  through  reference  to  the  work  of  Sattarthwaite  [1946].  Consider 
any  quadratic  form,  say  SSCi  and  let 


nSSC 
U  "  E(SSC) 

with 

2B2  (SSC) 
”  “  V(SSC) 


Then 


and 


E(u)  ■  n 


_2 

V(u)  «  -  V(SSC) 

E  (SSC) 

=  4E4 (SSC)  V(SSC) 
V2(  SSC)  E2 (SSC) 


-  2n 


Then  u  has  the  same  first  two  moments  as  a  chi-square  distribution  with 
n  degrees  of  freedom  so  th ot, ,  approximately. 


This  method  can  now  be  applied  to  SST  of  (22)  and  SSE  of  (24)  and 
the  results  will  be  similar  to  thobe  of  Box  [1954bJ.  The  same  approximate 
F-test  will  be  derived.  So,  using  SST  *bove,  let 


2E2 (SST) 

m  I  ■  ■  mu  it..—  I»J|- 

V(SST) 

»  (t-l)e  ,  in  Box's  notation, 
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Further, 

V(SST)  -  2tr(Qt$Qfc|)  + 

-  2tr[(j)  -  i  ll't)  ($  -  ~  ll'IJ]  +  4t'$t  ,  '-  -an  (27) 

-  2tr(|2  -  £  11' t2-  11 't  +  ~  ll'tU'*)  +  fc'tl 

•  2 jtr (|2)  -  |  l'$2l  +  ~  (l'$l)2J  +  4c'|t 

-  2 Jtr^2)  -  |  l'|2l  +  ■—  (rtl)2}  ,  if  Hq  of  (4)  is  true  .  (29) 

Substituting  (28)  and  (29)  in  (25)  yields 

[tr(*>  -  i 

£  m  -  ■■■  »  i  — i  ■ 

(t-l)  {tr($2)  -  |  l't 

New  it  is  well  known  in  Analysis  of  Variance  that  SSE  can  be 
ejqpressed  as 

SSE  -  Y'Q(A) Y  ,  using  (A2)  of  the  Appendix 

where 

A  -  Q*  "  !«.  "  f  11'  • 

t  t  t  •— 

Also, 

Y'  4,  Nbt(E(Y'),  I]  ,  $  -  diag(|) 

so  that 

E (SSE)  -  tr(Q(A)Z]  +  E(Y')Q(A)E(Y) 

-  (b-l)tr(Qt^)  +  E(Y')Q(A)E(¥)  ,  froa  (A6) 

-  (b-l)tr(Qt|)  ,  from  (A7) 


l'tli: 


5 - : - r-  ,  if  H  of  (4)  is  true  .  (30) 

!i4  <!'ti>2)  0 
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since 

E(Yj) A  -  [CP  +  0^)1'  +  I'ld  “  7  ii') 

-  Ot  +  Bjil*  +  I'  -  (p  +  0j)  £  I'll'  -  l  I'll' 

■  t'  ,  for  all  j  .  Ol) 

Therefore , 

E(SSE)  «  (b-l)E(SST)  ,  if  HQ  of  (4)  is  true 

Further, 

V(SSE)  -  2tr  [Q(A)£Q(A)E  ]  +  4E(Y')Q(A)EQ(A)E(Y') 

-  2tr[Q(A)EQtA)E]  ,  from  (A7)  and  (31) 

-  (b-l)2tr(A$A$)  ,  from  (A8) 

«  (b-l)V(SST)  ,  if  Hq  of  (4)  is  true  . 

So  let 

_  2E2(SSE) 
n2  =  V(SSE) 

2(b-l) V  oST) 

(b-1)  V(SST) 

-  (b-l)(t-l)£  ,  using  (25) 


Hence, 
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If  (t-l)t,  where  £  is  given  in  (30),  is  not  an  integer,  interpolate  in 
the  F-table  to  find  the  critical  point.  Note  that  equation  (30)  and 
(33)  are  the  same  as  Box’s  equation  (4.4) . 

Recall  now  the  example  presented  in  Chapter  II  using  the  model  of 
(1)  with  a  variance-covariance  matrix 


Of  interest  is  the  hypothesis  given  in  (4)  an  the  significance  of  the 
t-1  independent  contrasts  in  the  t's.  The  first  approach  will  be  the 
exact  one  using  the  statistic  given  in  (14) .  To  compute  SST*  of  (21) 
and  SSE*  of  (23)  it  will  be  necessary  to  have  values  for  \*  of  (18), 
g.'l  ,  and  Q  a.  ,  where  A  and  a.  are  given  in  equations  (33)  and  (34)  of 
Chapter  II.  The  values  for  these  are  given  in  Table  I  for  t  ■>  2,  •••  ,6 
and  t  *  8  . 

Hence,  fis  d  a  value  for  p  or  confute  an  estimate  of  it.  Then,  to 
obtain  SST*,  calculate  Y.  and  use  the  tables  with  the  formula  given  in 
(21)  .  To  find  3SE*  corr^iute  Y^  -  for  each  j  and  use  the  tables  with 
the  equation  in  (23) .  Finally  calculate 


F* 


(b-1) 


SST* 

SSE* 


and  cor^pare  this  with  a  tabled  F 

(t-1, (b-1) (t-1) 


at  some  a-level  of 


significance . 
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Tsble  I — continued 


t  -  5 


i-1 
Qt  2l 


1-2 

Ct 


1-3 
2t  23 


i-4 


■t  -4 


1-5 
Qt  25 


■  1-2/r 

■  5/3" 

8 

'  5/3* 

f  1+2 /3l 

4+3/3 

5/3 

-  2 

-5/7 

-4-3/T 

6-2/3 

0 

-12 

0 

6+2/3 

-4+3/T 

-5/3 

-  2 

5/3 

-4-3/T 

1-2/3 

-s/T 

8 

-5/T 

_  1+2/3 

divisor  «  lo/3 


Ai 

3 

1 

-1 

-3 

/3  +  3o 

1  +  P 

J  1  - 

P 

/3  - 

3p 

21-1 

i  +  -2- 
/3 

0 

-i-  0 

/3 

-1  + 

T 

t  —  6 

1-1 

1-2 

1-3 

1-4 

1-5 

1-6 

Qt  2l 

^  22 

fit  T 

Qt  24 

Qt  25 

fit  2fi 

-  .889001 

‘  2.34564 

'  2.29783 

‘  2.92488 

"  2.10460" 

' 

'  1.30176" 

.15488 

2.92488 

0.67476 

-1.30176 

-3.16572 

-2.34564 

.73412 

1.30176 

-2.97264 

-2.34564 

1.06092 

2.92488 

.73412 

-1.30176 

-2.97264 

2.3C64 

1.06092 

-2.92488 

.15488 

-2.92488 

0.67476 

1.30176 

-3.16572 

2.34564 

-  .68900_ 

-2 . 34564 

2.29788 

-2.92488 

_  2.10480 

► 

-1.30176 

xi 

1.80180 

1.24684 

0.44480 

-0.44480 

-1.24684 

-1.80180 

1+1. 80180p  1+1. 24684c  1+0.444800 

L -0.44480c 

L- 1.24684c 

1-1.30180P 

0!  1 
-1- 

2.34191 

0.0 

0.67026 

0.0 

0.2576 

0.0 

divisor  -  /31. 50306 


T m.'  1  • ;  I --continued 


t.  -  8 


1=1 

1=2 

i=3 

1=4 

-1 

Ct  22 

Ct  S3 

Qt  24 

r-0. 172954 

"  0.030314* 

r  0.3061861 

0.464243 

-0 .0J1170 

!  0.464243 

0 . 30 j186 j 

0. 161229 

0.074064 

|  0. *98243 

i  -C.  102062! 

j  ' 

-0.408248 

0.170060 

!  0.161229! 

-0.510311'’ 

-0. 30  3014 

0.1. 0060 

!  -0. 161229! 

i  ! 

i 

-0.510  no 

!  0.303014 

O.C  74064 

! -0.408249 

'-0.102002* 

I  0.408248 

~0.0311'70 

j -0.464243 

i 

0 . 306 1'iC ' 

-0.161229 

j 

_-0. 172954 

-0.30  30  14 

L  0 . 3C6i^t. 

-0.464243] 

1 

\  n  1 

1. 87938 

1.53206 

1 

0 . 3  ■.  V 

1  1 

1+1. 67938c 

1+1. ,5  3?08o 

► 

"  ;r  t 

*11  i 

2.67747 

0.0 

o.t 

1=5 

X  C 

*  _  T 

2t  25 

2t  -6 

'  T  — 

’  t  -8 

'  0.414798] 

"  0.4082  48; 

j*  0.28186  7] 

;  0.1Gi::29] 

-0.210674 

-0. 408248 

’ -0.4b5690: 

:  -  v.  30  3014: 

-0.457692 

O.C 

I  0.38' 0-0 1‘ 

K  40  82  48* 

0.253569 

0. 408248! 

1 -0.16287 0 

-  0 . m  .  13 

0.253569 

-0.408248; 

| -0. 182b 7-* 

0.464243; 

-0.457692 

0.0 
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l*t2l  -  a4£2 C1-H5 i2  +  (t-2)a+2p)2] 

-  o4[t  +  4?  (t-1)  +  2p 2  C2t-3)  1 

•\ 

Therefore, 

tr(J2)  -  |  l'*2!  +  ~  (1*4) 2 

-  o4jt  +  2p2(t-l)  -  |tt  +  4p  (t-1)  +  %2(2t-3)l  +  +  ?^it-l)]2j 

4  (t-1)  (t~2f  )2  T  .  2p2 (t+1)  (t-2) 2 
cr  5  I  1  +  2 

L  (t-1)  (t-2p)  J 

Hence, 

(tr  *  -  i  l'$l)2 

(t-1)  (tr($2)  -  |  l'f.2l  +  ~-(l'$l)2  ) 

»  ill  ,t-2p ) 2  /o4  ZLiLSZMtlx  .  2p2 

t2(t-l)  /  tZ  I  (t-1) (fc-2p J 

2 

which  is  equation  (6,10)  in  Box's  notation.  Now  compare  the  F-etatistic 
in  (35)  with  a  tabled  F[ (t-l)ef(b-l)  (t-De)  at  Bom  a~leVel  of  significance. 
Of  course,  the  value  of  p  or  an  estimate  of  p  will  be  needed  to  compute 
e,  and  if  (t-l)e  is  not  an  integer  then  on  must  interpolate  in  the 

F  tables. 

In  summary,  there  has  been  derived  both  an  exact  and  approximate 
method  for  testing  the  hypothesis  of  (4).  The  exact  test,  statistic  is 
given  in  (34)  and  requires  much  tine  and  labor  unless  tables  of  latent 


r> 


1  +  2p 


(t+1) (t-2)' 


r] 


-1 


(t-1)  (t-2p)‘J 


(37) 


roots  *M  vector*  of  M  -are  available.  The  approximate  test  statistic  Is 

—  ..  \\  .  V- 

givtn  in  (33}  and  is  the  usual  F-statietic  of  a  RRD  where  the  errors  are 
normally  laid  independently  distributed?  so  it  is  relatively  easy  to  _ 
compute*  However/  it  may  be  necessary  to  interpolate  in  the  F  table  to 
find  ths  appropriate  critical  point  in  testing  HQ  .  In  each  of  the  above 
cases  one  must  either  know  the  value  Cl  p  or  be  able  to  find  an  eatinate  " 
of  it.  Which  ssethd  in  best  will  depend,  cn  this  estimate.  The  next 


chipter  will  discuss  in  detail  a  Monte  Carlo  study  comparing  these  tests 
when  'Vie  such  estimate  of  p  is  used. 


CRAP  ITS  F.  \r 

•?  :  h  MONTE  CARLO  STUDY  ' 

In  order  to  coapare  the  two  teat  statistics  given  in  equations  (14) 
<s»d  (33)  of  Chapter  IV  it  is  necessary  to  find  an  estimate  of  p,  say  p  . 
This  will  now  bs  dene  for  the  example  given  in  the  last  chapter,  using 
the  variance -covariance  matrix 


1 


(1) 


A  Monte  Carlo  stud/  is  made  comparing  different:  known  significance  levels, 
e,  with  the  significance  levels  using  the  ’exact1  ter;  statistic  in 
equation  (14)  above,  i.e., 

CC^T* 

F(  ’exact* )  =  (b~l)  ^  F[  (t-1)  (b-1)  (t-1)  ]  '  xf  H0  ls  trUe  (2) 

the  ap’ roximate  test  statistic  in  equation  (33)  above,  i.e., 

SST 

Ffapprox.)  »  (b-1)  —  ^  (t.1)E,  (t.1)c,  ■  if  »0  iB  true  <3> 

and  the  usual  F-statistic  which  can  be  computed  using  equation  (33)  above, 
i.e . , 
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SST 

F(usual)  -  (b-1)  ggg  *■'  F[(t-l},(b-i)(t-l)J  '  i?:  H0  18  true  *  (4' 

Tha  term  'exact'  will  be  vise;!  to  designate  the  exact  test  of  the  last 
d.ipter  when  an  estimate  for  p  is  used)  thin,  of  coursft,  will  not  be  an 
exact  test  of  significance  but  will  be  referred  to  as  the  'exact'  test 
in  order  to  keep  in  mind  its  structure.  Notice  that  the  only  difference 
between  the  usual  statistic  and  the  approximate  statistic  is  the  degrees 
of  freedom  us-d  when  finding  the  critical  region.  The  results  of  the 
study  prove  to  be  helpful  in  determining  which  of  the  above  statistics 
is  appropriate  when  the  \  in  (1)  is  used. 

In  the  example  of  Chapter  IV  it  was  shown  in  equation  (36)  that 


b  t 

SSE  ®  y  T  [Y.  ,  -  Y. 
j-1  i«l 


2 

in  equation  (6)  the  result  is  an  unbiased  estimator  of  P  when  o  is  known, 
i.e  , , 


B(p)  -  p 


with 
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If  cr  is  unknown  it  can  be  estimated  using  the  C  method  derived  in 
Chapter  II.  In  equation  (43)  of  that  section 


«x-i£  -  W 


where  * 


so  that 


SSE 


JL  2 

2  X  (b-1)  (q^l) 


e(sse^)  -  (b-1)  (q,- l)o 


(7) 


Also,  from  equation  ( 44)  of  that  section 


b 


SSE2  *  l  l  -  52i, 
]=<1  1*=1  J 


-  y{2)  +  7(2)]2 

e  •  j  •  » 


where 


so  that 


fffi  2 

rt2  X (b-1) (q  -1) 


E(SSE2)  «  (b-1) (q2- 1)0 


(8) 


Combining  (7)  and  (8)  yields 


Hence , 


EfSSJ^  +  SSE  )  -  (h-l)(q1  +  q?  -  2)0 


*  (b-1)  (t-l)o  ,  as  q^  +  q2  ®  t 


_2  SEE  +  SSE2 


(b-1) (t-l) 


is  an  ;inbiased  estimator  for  o  .  An  easier  aethod.for  staining 


31 


SSE^  +  SSE2  would  be  to  first  calculate  SSE  and  then  subtract  off  SSE^ 
where 


b 

SSE  -  l 

j-1 


(9) 


with 


w 


w 


j 


and 


so  that 


t L  .  5<2>) 

2  r-j  Y-j  • 
j  V2  (t5-1)  {-(1)  ~(2)  \ 

2  (t— 2 )  \*.j  -j  / 


v  is  even 

t  is  odd 


,  SSE  -  SSE, 
-2  _ 3 

0  "  (b-1) (t-2) 


Substituting  the  above  estimate  in  (6)  yields 


(10) 


(11) 


y  '  - 

Notice  that  when  o’  is  known.-  p  is  an  unbiased  estimator  of  p,  but  when 

2  2 
o  is  unknown  this  is  not  true.  lowever,  in  {ID  a  is  replaced  by  the 

unbiased  estimator  in  (10) .  It  is  also  relatively  easy  to  compute  p  of 

(6)  and  (11).  Because  of  these  two  points,  i.e.,  pseudo-unbiasedness  and 

ease  of  computation,  this  estimate  of  P  was  used  i.r>  the  Monte  Carlo  study 

given  be  lew.  Other  estimates  of  "  could  be  devised  but  none  are  as 

staple  to  compute  as  this  cue. 

Consider  now  goner.-  ting  a  random  sample  from  a  multivariate  normal 
population  having  mean  0  and  the  variance -covariance  matrix  given  in  (1) , 
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2 

where  p  and  a  are  specified.  Using  this  sample  it  would  then  be  easy 
A  2 

to  confute  the  p  of  (11),  assuirdng  o  is  unknown,  and  the  teat  statistics 
in  (2) ,  (3)  and  (4) ,  assuming  p  is  unknown.  Comparisons  could  be  drawn 

A 

between  the  real  value  for  P  and  the  estimated  values  using  p  .  Also, 
one  could  compare  the  three  statistics  above  to  see  which  appears  to  be 
most  correct  when  p  is  used.  This  has  been  done  in  a  series  of  experi¬ 
ments  using  a  UN I VAC  1108  computer  where  t-3  and  b*3,  5;  t«5  and  b»3,  5,  7; 

2 

t-8  and  b-3,  5,  8,  with  o  *  1,  and  p  «  0.45,  0.22,  0.0,  -0.22  ,  -0.45  . 

Each  experiment  was  run  1500  times,  varying  t,  b,  and  p  and  using 
different  samples  for  each  replication.  In  each  replication,  p  of  (11) 
was  computed  and  the  resulting  val'u*  was  used  to  calculate  the  test 
staf'. sties  in  (2),  (3)  and  (4).  If  the  value  of  p  ever  exceeded  the 
limits  on  p  as  given  in  equation  (32)  of  Chapter  II,  i.e.,{2  oos(^~-}}  , 

then  this  end  value  was  used  instead  of  p  .  This  resulted  in  a  partially 
biased  estimate  of  p  but  a  more  correct  one.  Counts  were  then  made 
of  the  nunber  of  times  a  certain  test  statistic  fell  in  the  critical 
region  using  three  different  significance  levels,  a  *»  .10,  .05,  .025  . 

Table  II  below  lists  the.^e  counts  in  terms  of  probabilities. 

A  large  number  of  values  for  -  of  (11)  were  also  printed  out. 

These  indicated  that  this  estimator  was  fair  in  that  region  where  p  was 
positive;  but  with  a  negative  p,  o  performed  poorly.  Consequently ,  as 
the  tables  indicate,  the  test  statistic,  F( 'exact'),  is  not  good  when 
p  is  used.  A  better  estimate  of  P,  however,  might  improve  this  test 
greatly.  Surprisingly,  F(usual)  was  relatively  accurate,  even  when  |p| 
varied  from  zero.  The  statistic  that  was  most  consistent  over  the  values 
for  p,  t,  and  b  was  F(approx.)  which  turned  out  to  be  somewhat  conserva¬ 
tive.  Another  estimate  of  p  might  also  improve,  this  test. 


Table  XX 
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Table  II — continued 
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Xt  is  suggested  then  that  when  f  has  the  j>tsi  of  (1)  and  P  is  known, 

one  should  use  P( ’exact’)  of  Chapter  XV  to  test  aQ  .  When  P  is  unknown, 

2  2 

satinet®  p  using  (6)  if  a  is  known  and  (11)  if  a  is  unknown.  Then  to  test 
Hq,  evaluate  F{ approx. )  of  (3)  and  this  p  .  If  one  knows  that  jp|  is  not 
too  far  from  zero,  but  the  actual  value  of  p  is  unknown,  calculate 
F  (usual)  of  (4)  and  do  not  even  estimate  p  .  Finally,  use  another  estimate 


of  p  if  a  be^cor  one  is  fovsid. 


CHAPTER  VI 


SUMMARY 

In  this  paper  methods  hove  been  proposed  for  testing  the  effects 
of  certain  sets  of  treatment  contrasts  in  a  randomized  block  experiment 
where  the  errors  are  not  independently  distributed  but  have,  instead,  a 
variance-covariance  matrix  of  the  form 

«=  °2^t  +  pjM*  '  j  *  1#  •••  ,  b  .  (1) 

These  te3tn  require  neither  that  the  nunber  of  blocks  exceed  the  number  of 

treatments  nor  the  confutation  of  large  order  inverse  matrices,  as  does 
2 

Hotelling's  T  test.  In  fact,  some  of  them  use  the  usual  test  ratio 


Chapter  II  presents  the  C -method  which  transforms  the  original  design 
into  one  in  vhich  the  errors  are  independently  distributed.  An  example  on 
serial  correlation  within  blocks  is  examined  using  this  approach.  Although 
not  unique,  the  teat  statistic  developed  here  has  an  exact  distribution, 
namely,  the  F- distribution,  and  is  not  too  difficult  to  derive.  Unfortunately, 
it  is  useful  in  testing  only  sets  of  treatment  contrasts  and  net  in  testing 
the  equality  of  all  the  treatment  means. 

In  Chapter  III  the  D- method  is  proposed  which  can  be  used  as  an 
alternative  t?  the  C -method  when  the  rank,  of  H  is  small.  This  section 
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also  analyzes  an  example  in  animal  breeding  where  this  method  appears  to 
be  very  useful.  The  test  statistic  derived  is  quite  easy  to  obtain  end 
tlie  sets  of  treatments  contrasts  considered  almost  span  the  parameter 
space  of  t  . 

Chapter  IV  gives  two  methods  which  can  be  used  in  testing  all  t-1 
independent  contrasts.  Botn  require  that  be  identical  to  p,  for  all  j, 
and  either  that  p  is  known  or  an  estimate  of  p  can  be  obtained.  If  p  is 
known,  one  approach  is  exact  while  the  other  is  approximate;  if  p  is 
unknown,  both  are  approximate.  The  example  of  Chapter  II  is  studied  in 
detail  and  some  tables  are  given  which  are  useful  in  deriving  the  test 
statistic  of  the  exact  method. 

In  Chapter  V  a  Monte  Carlo  study  is  made  on  the  methods  of  Chapter  IV, 
using  an  easily  computed  estimate  of  p  *nd  the  example  of  Chapter  II.  The 
results  indicate  that  the  approximate  test  is  quite  accurate  thile  tlie 
'exact'  one  does  not  perform  well  due  to  the  inaccuracy  of  the  estimator 
of  p  .  Surprisingly,  the  F~test  used  when  the  errors  are  independently 
distributed  performs  quite  well  for  this  example. 

In  conclusion,  if  one  is  interested  in  testing  the  equality  of  all 
the  treatment  means,  use 

(1)  the  exact  method  of  Chapter  IV,  if  p_.  is  identical  to  p, 
for  all  j,  and  p  is  known; 

(2)  the  approximate  method  of  Chapter  IV,  if  is  identical 
to  P,  for  all  j,  and  P  can  be  estimated; 

(3)  Hotslling’s  T2  if  b  >  t;  is  identical  to  p,  for  all  j; 
and  the  necessary  inverse  matrix  is  easier  to  compute  than 


(1)  or  (2)  above; 
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(4)  the  D~method  of  Chapter  III,  if  (1),  (2),  and  (3)  do  net 
hold  and  the  rank  of  H  is  small  enough.  In  this  case  p._, 
does  not  have  to  identical  from  block  to  block. 

It  one  is  satisfied  with  testing  certain  sets  of  treatment  contrasts, 
use 

(1)  the  C-method  of  Chapter  II,  if  these  sets  can  be 
obtained; 

(2)  the  Dmethod  of  Chapter  III,  if  the  rank  of  M  is  small 
and  these  setr  can  be  derived; 

2 

(3)  Hotelling's  T  if  b  >  t;  is  identical  to  p,  for  all  j; 
and  the  inverse  matrix  is  easier  to  compute  than  (1)  or  (2) ; 

(4)  the  single  degree  of  freedom  tests  of  Chapter  II,  if  is 
identical  to  p ,  for  all  j ,  and  individual  treatment  compari¬ 


sons  are  of  interest. 


APPENDIX  A 


SOME  RESULTS  ON  MATRICES 

Let  A  and  B  be  any  t  *  t  mat rl  cat  and  let  Q^(A)  and  Q(A)  be  tb  *  tb 
matrices  such  that 


and 
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«t M  m  b 
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Further, 
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